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1.  Introduction .  This  paper  is  devoted  to  the  investigation  of  various 
measures  of  optimality  for  cluster  techniques.  Before  proceeding,  it  is  appro¬ 
priate  to  discuss  the  nature  of  the  cluster  methods  that  will  be  considered. 

The  starting  point  is  a  finite  (nonempty)  set  P  equipped  with  a  dissimilari¬ 
ty  measure  (henceforth  known  as  a  DC)  d.  This  is  merely  a  mapping  d:P  *  P  ♦  R+, 
the  set  of  nonnegative  real  numbers,  such  that 
(DC1)  d(a,b)  «  d(b,a) , 

(DC2)  d(a,a)  -  0 


for  all  a,b  e  P.  In  the  Jardine-Sibson  model  for  cluster  analysis  [16],  a 

■ft 

cluster  method  converts  this  input  DC  into  a  numerically  stratified  clustering 
(NSC);  this  is  a  mapping  C:R*  t ,  where  £  denotes  the  set  of  reflexive 
symmetric  relations  on  P,  ordered  by  inclusion,  such  that 
(NSC1)  C  is  isotone, 

(NSC2)  C(h)  -  P  x  p  for  some  h  e  R+, 

(NSC 3)  Corresponding  to  each  element  h  of  R+,  there  is  a  6  >  0 
such  that  C(h)  ■  C(h  ♦  6) . 

For  each  d  e  C(P),  the  set  of  DC's  on  P,  there  corresponds  an  NSC  Td  given  by 
Td(h)  -  ((a,b) :d(a,b)  <  h}  , 
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everal  commonly  used  optimality  measuies  are  compared  and  classified  as  to 
their  performance  with  monotone  equivariant  cluster  techniques.  A  new 
measure  is  introduced  and  compared  to  the  earlier  measures.  The  measures 
are  then  applied  to  determining  the  optimality  of  several  cluster  techniques 
when  they  are  applied  to  some  concrete  data  that  arises  from  the  psycholo¬ 
gical  and  social  sciences,  mb 
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and  Jardine  and  Sibson  argue  in  [16]  that  d  -*•  Td  is  a  bisection  between  C(P) 
and  the  set  of  all  NSC's  on  P.  For  that  reason,  a  cluster  method  may  either 
be  regarded  as  a  mapping  F:C(P)  -*•  C(P)  or  as  a  mapping  F  on  the  set  of  NSC's; 
here  F(Td)  -  T(Fd)  for  all  d  e  C(P) . 

So  that  the  abstract  theory  of  partially  ordered  sets  could  be  brought  to 
bear  on  the  theory  of  cluster  analysis,  an  order  theoretic  model  for  the  subject 
was  introduced  in  [10]  and  further  developed  in  [11],  [12],  [13]  and  [14].  The 
idea  is  to  notice  that  an  NSC  is  the  same  thing  as  a  residual  mapping  of  R* 
into  E.  Here  a  mapping  f  of  a  partially  ordered  set  A  into  a  partially 
ordered  set  B  is  said  to  be  residual  if  f  is  isotone,  and  there  is  an  isotone 
mapping  f*:B  -*■  A  such  that  f*f(a)  <_  a  and  ff*(b)  ^  b  for  all  a  c  A,  b  c  B. 
This  associated  mapping  f*  is  the  residuated  mapping  determined  by  f.  A  full 
treatment  of  residuated  and  residual  mappings  may  be  found  in  [1].  Letting  Res(B,A) 
denote  the  set  of  residuated  mappings  of  B  into  A,  and  Res+(A,B)  the  resi¬ 
dual  maps  of  A  into  B,  a  cluster  method  may  now  be  defined  as  follows.  The 
nonnegative  reals  are  replaced  by  an  abstract  join  semi lattice  L  with  0,  and 
the  set  E  of  reflexive  symmetric  relations  by  a  pair  M,  N  of  finite  partially 
ordered  sets,  each  of  which  has  a  largest  element  that  is  not  its  only  element . 

A  cluster  method  can  now  be  regarded  as  a  function  F:Res(M.L)  ■+•  Res(N.L)  or 
as  a  function  F:Res+(L,M)  Res+(L,N).  For  purposes  of  the  present  work,  this 
level  of  abstraction  is  not  needed,  and  we  shall  view  a  cluster  method  as  a 
function  on  C(P)  or  as  a  function  on  Res+(R+,E) . 

If  one  assumes  that  the  input  DC  d  has  only  ordinal  significance,  it  is 
shown  in  [12]  that  one  should  use  a  monotone  equivariant  cluster  method.  This 
is  a  cluster  method  F  having  the  property  that  for  eacg^g^^automorphism  6 
of  R+,  F(6d)  ■  8F(d) .  A  more  useful  characterization  of  this  type  of  cluster 
method  occurs  in  [13].  It  states  that  a  cluster  method  F  is  monotone 
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equivariant  if  and  only  if 

(1)  The  range  of  Fd  is  always  contained  in  the  range  of  d, 
and 

(2)  If  0  =  h()  <  hj  <  . . .  <  h^  is  the  range  of  d,  then  the  sequence 
TF(d)(hQ)  £TF(d)(hj)  £  ...  £TF(d)(ht)  depends  only  upon  the  sequence 

Td(hQ)  <  Td(hp  <  _  <  Td(ht)  and  is  independent  of  the  numerical 

values  of  the  h. 's. 

L 

Thus  a  monotone  equivariant  method  may  be  regarded  as  a  transformation  of  a 
sequence 

Rfl  c  Rj  c  .  .  .  c  R  =  P  x  p 
of  reflexive  symmetric  relations  into  a  sequence 

s0  £  Si  £  •  •  •  £  st  =  P  x  P 

of  relations  which  in  most  applications  are  taken  to  be  equivalence  relations. 

All  of  the  algorithms  we  shall  adopt  are  Type  I  algorithms  in  that  for  i  *  0,1,..., t, 
Sj  depends  only  upon  RQ,R ^ , . . . ,R^. 

Suppose  now  that  one  wants  a  measure  of  optimality  that  may  be  applied  to 
Type  I  cluster  methods.  What  properties  should  such  a  measure  have?  Though 
the  following  list  is  not  intended  to  be  complete,  each  of  the  conditions  for 
such  a  measure  does  at  least  seem  plausible. 

(01)  An  optimality  measure  should  be  a  mapping  0:C(P)  *  C(P)  ■*  T,  where 
T  =  R+,  (0.1J  or  1-1,1]. 

(02)  O(d.d')  =  0(d'.d)  for  all  d,d'  e  C(P) . 

(03)  If  0(d,d')  <  0(d,d"),  then  in  some  readily  interpretable  sense,  d' 
should  fit  d  better  than  d"  does.  Alternately,  it  would  suffice 
if  -0  had  this  property. 

(04)  0  should  bo  monotone  equivariant  in  the  sense  that  if  O(d.d')  <  0(d,d"), 
and  if  0  is  any  order  automorphism  of  R+,  then  0(8d,6d')  <  O(9d,0d") . 
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(05)  Viewing  a  cluster  method  as  a  transformation  of  a  sequence 

R0  c  Rl  c  ...  c  Rt  «  P  *  P  into  a  sequence  c  Sj  c  ...  c  St  *  P  x  P, 
it  should  not  be  possible  to  necessarily  improve  the  value  of  0  by 
setting  for  one  or  more  values  of  i. 

The  exact  meaning  of  axiom  05  will  be  clarified  as  it  is  applied  in  specific 
situations. 

2.  The  optimality  measures.  A  number  of  optimality  measures  will  be  con¬ 
sidered.  It  will  be  convenient  to  briefly  describe  them  in  this  section. 

0P1 .  The  cophenetic  correlation  coefficient.  This  is  the  ordinary  product 
moment  correlation  between  the  input  and  output  DC's.  It  was  introduced  by 
Sokal  and  Rohlf  [22],  and  is  probably  the  most  commonly  used  measure  of  optimali¬ 
ty.  It  should  be  noted,  however,  that  some  difficulties  can  occur  when  one 
applies  the  cophenetic  correlation  coefficient  to  input  data  having  only  ordinal 
significance.  This  is  caused  by  the  fact  that  this  coefficient  is  not  itself 
monotone  equivariant,  and  does  not  behave  well  in  the  presence  of  a  large  number 
of  ties.  This  was  illustrated  in  [13].  p.  158  but  it  will  be  convenient  to  provide 
a  similar  illustration  here.  Let  P  ={a,b,c,e),  and  consider  the  following  set 
of  binary  attribute  data: 


♦attributes 

nl 

n2 

n3 

"4 

n5 

n6 

a 

1 

0 

1 

0 

0 

0 

b 

1 

0 

0 

1 

0 

0 

c 

0 

1 

0 

0 

1 

0 

e 

0 

1 

0 

0 

0 

1 

A  dissimilarity  measure  will  be  defined  from  this  table  by  using  the  simple 
matching  coefficient.  To  obtain  the  value  of  d(x,y)  for  x,y  e  P,  this  amounts 
to  counting  up  the  number  of  attributes  on  which  x,y  disagree,  and  dividing  by 


the  total  number  of  attributes.  Three  cases  will  be  considered. 
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Case  1 . 

nl 

=  n2  = 

i; 

n3  = 

3,  =  1, 

n5  = 

n6=  2. 

Case  2. 

nl 

=  n2  = 

3, 

n3  = 

3,  n4  =  1, 

!1s  = 

n6=  2. 

Case  3. 

nl 

=  n2  = 

8; 

n3  = 

31,  n4  =  1 

*  n5 

=  n6  =  16. 

These  lead  respectively 

to 

the  following  three  dissimilarity 

measures : 

dl 

a  b 

c 

e 

^2_ 

a  b 

c 

e  d3 

a 

b 

c 

e 

a 

0  .4 

.7 

.7 

a 

0  .29 

.79 

.79  a 

0 

.40 

.79 

.79 

b 

0 

.5 

.5 

b 

0 

.64 

.64  b 

0 

.41 

.41 

c 

0 

.4 

c 

0 

.29  c 

0 

.40 

These  3  dissimilarity  measures  are  equivalent  in  terms  of  their  rank  orderings, 
so  a  monotone  equivariant  cluster  method  will  necessarily  produce  an  equivalent 
output  for  each  of  them.  Let  us  consider  the  following  candidates  for  output  DC's: 


d4 

a 

b 

c 

e 

d5_ 

a 

b 

c 

e 

a 

0 

k 

k 

k 

a 

0 

h 

j 

j 

b 

0 

j 

j 

b 

0 

j 

i 

c 

0 

h 

c 

0 

h 

Here  in  Case  1, 

ii 

■u 

u. 

II 

•5, 

'K 

II 

<•  • 

in  Case  2, 

h  = 

.29,  j  =  .64,  k  = 

•  79, 

and  in  Case  3, 

h  =  .40,  j  = 

.41 

and  k  = 

.  79 .  Let  us 

now 

examine  the  values 

of 

the  cophenetic  correlation  coefficient  for  these  2  outputs. 


d4 

d5 

Case 

1 

.59 

.73 

Case 

2 

.55 

.96 

Case 

3 

.70 

.52 

Notice  that  in  Case  3,  the  cophenetic  correlation  coefficient  predicts  that  d^ 
is  superior  to  d,.;  yet  no  Type  I  cluster  method  would  ever  produce  d^  since  the 
first  level  of  input  data  leads  naturally  to  the  classification  {a,b},  {c,e} 
while  d^  reflects  the  classification  {a},  {b } ,  {c,e}.  Apart  from  the  above 
problems,  the  values  of  an  input  DC  are  not  independent,  so  it  is  difficult  to 


provide  any  statistical  significance  to  this  coefficient.  Indeed,  as  was  pointed 
out  by  Jardine  and  Sibson  [16],  p.  107,  "...justification  for  its  use  rests  on 
its  practical  utility  rather  than  on  any  resemblance  to  statistical  correlation 
measures." 

Next  we  consider  some  optimality  measures  that  are  based  upon  distance 
measures.  In  what  follows,  the  vector  (x^^,  •  • .  ,x^)  will  denote  the  values 
of  the  input  DC,  and  the  vector  (y^ ,y . . . ,y^)  the  values  of  the  output  of 
some  cluster  method  under  consideration.  We  then  have 

0P2 .  [Z(x.  -  y.)2]*5 

0P3.  [Z(x.  -  y.)2]-5/(  x.2)-5 

0P4.  [SCI  *  (Xi/x.))2]-5 

OPS.  E|x.  -  y.|  . 

Measures  0P2  and  0P5  are  both  suggested  by  Jardine  and  Sibson  [16],  p.103. 

The  remaining  measures  are  in  Kruskal  [17],  pp.  307-8  for  use  as  stress  measures 
in  multidimensional  scaling.  They  are  each  measures  of  the  distance  between  the 
input  and  output  DC's,  and  from  our  point  of  view  each  has  as  a  major  defect  the 
fact  that  it  is  not  monotone  equivariant,  and  consequently  should  not  be  used 
as  an  optimality  measure  with  ordinal  data. 

Hubert  and  Baker  [9]  introduce  a  measure  that  is  based  upon  the  Goodman- 
Kruskal  correlation  coefficient  [3].  To  see  how  it  goes,  we  consider  all  ordered 
pairs  of  unordered  pairs  of  elements  of  P.  Assuming  that  d  is  a  dissimilarity 
measure  on  P  and  that  F  is  a  cluster  method,  the  pair  ({a,b}, {c,e})  is 
called  consistent  if  d(a,b)  <  d(c,e)  and  Fd(a,b)  <  Fd(c,e);  it  is  called 
inconsistent  if  d(a,b)  <  d(c,e)  and  Fd(a,b)  >  Fd(c,e).  One  then  lets  S+  = 
the  number  of  consistent  pairs,  S'  the  number  of  inconsistent  pairs,  and  takes 
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S  -  S 

Y  =  -  .  This  assumes  that  there  are  no  ties  in  the  values  of  the  input 

S+  -  S' 

data  provided  by  d.  In  the  presence  of  T  ties  in  d,  one  can  argue  that 

S+  _  s”  -  T  s+  -  S~  +  T 

Y  must  lie  between  — - -  and  — - - .  This  amounts  to  considering 

S+S‘+T  S+S’+T 

the  two  extreme  possibilities:  that  a  tie  always  leads  to  an  inconsistent  pair, 
and  that  a  tie  always  leads  to  a  consistent  pair.  With  this  thoughtin  mind,  we 
shall  use  the  notation 


S*  -  S~  -  T 

S+  +  S'  +  T 

S*  -  S'  +  T 

S+  ♦  S'  +  T 

and  take  y  =  [Yi»Yyl>  For  further  details  of  the  derivation  of  y  as  well  as 
for  a  discussion  of  some  of  its  statistical  properties,  the  reader  is  referred 
to  [9].  At  first  glance  the  y  -coefficient  seems  extremely  attractive.  First  of 
all,  it  is  monotone  equivariant.  Secondly,  it  has  an  interesting  probabilistic 
interpretation.  Finally,  it  seems  intuitively  clear  that  higher  values  of  y 
should  lead  to  the  conclusion  that  the  corresponding  cluster  methods  are  better 
reflections  of  the  input  data.  But  more  careful  reflection  shows  that  this 
measure  has  a  danger  associated  with  it.  The  danger  is  caused  by 
it  ignores  pairs  ({a,b} , {c,e})  where  dCa,b)  <  dCc,e)  and  Fd(a,b)  =  Fd(c,e) . 
This  can  best  be  illustrated  with  a  concrete  example  that  we  take  from  [9],  p.90: 


2,3, 

,4,5,6}, 

and 

d 

is  given  by 

1  2 

3 

4 

5 

6 

1 

3 

4 

14 

1 

8 

2 

5 

9 

11 

12 

3 

13 

2 

10 

4 

6 

7 

5 

15 

0P7.  yl= 
OPS.  Yy  = 


The  complete  linkage  output  for  this  is: 


Level 

Nontrivial  clusters 

1 

{1,5} 

4 

{1,3,5} 

7 

{1,3,5},  {4,6} 

11 

{1,2, 3, 5},  {4,6} 

15 

{1,2, 3, 4, 5, 6} 

The  value  of  y  for  the  above  output  is  0.78.  By  discarding  levels  of  output, 
this  value  of  y  can  be  "improved"  as  follows: 


Output  levels 

V 

1,4,11,15 

0.83 

1,4,7,15 

0.84 

1,4,15 

0.95 

1,15 

1.00 

Indeed,  y  will  equal  1.00  for  any  input  DC  d,  if  the  most  similar  pair  of 
objects  is  clustered  at  level  1  and  all  other  pairs  at  level  2.  It  would  seem 
that  y  tends  to  favor  cluster  methods  that  produce  few  output  clusters.  Apart 
from  this,  y  is  clearly  not  going  to  give  much  information  in  the  presence  of 
a  large  number  of  ties.  This  sort  of  problem  has  led  us  to  modify  the  definition 
of  y.  Specifically,  one  takes  ({a,b},{c,e})  to  be  a  consistent  pair  if 


either  d(a,b)  <  d(c,ej  and  Fd(a,b)  <_  Fd(c,e)  or  d(a,b)  =  d(c,e)  and 
Fd(a,b)  =  Fd(c,e)^;one  takes  it  to  be  inconsistent  if  d(a,b)  <  d(c,e)  and 
Fd(a,b)  >  Fd(c,e)  or  if  d(a,b)  =  d(c,e)  and  Fd(a,b)  >  Fd(c,e) .  This  modi¬ 
fication  reflects  the  fact  that  if  (c,e)  is  clustered  at  level  h,  and  if 
(a,b)  is  more  similar  or  equally  similar,  then  it  too  should  be  clustered  at 
level  h.  One  defines  S+  and  S'  as  was  done  earlier  with 
0P6.  y'  =  2 - 2 —  . 

s+  +  s' 


\ 

3 

i 


Note,  however  that  y'  still  suffers  from  the  defect  that  it  can  be  "improved"  by 
removing  desirable  cluster  levels.  (See  the  table  at  the  end  of  the  discussion  of  0P11) . 

^  Each  pair  ({a,b},{c,e})  to  be  counted  only  once. 
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This  brings  us  to 

0P9.  Kendall's  Tau-correlation  coefficient. 

0P10.  Spearman's  Rho-correlation  coefficient. 

These  are  both  rank  order  correlation  coefficients,  and  are  consequently  mono¬ 
tone  equivariant.  Like  the  cophenetic  correlation  coefficient,  they  tend  to 
behave  rather  poorly  in  the  presence  of  a  large  number  of  ties.  Furthermore, 

i 

since  the  underlying  statistical  assumptions  that  validate  their  use  as  corre¬ 
lation  coefficients  are  simply  not  present,  no  statistical  significance  should 
be  attached  to  their  use.  They  should  be  viewed  as  ad  hoc  measures  of  optimality; 
nonetheless,  they  are  certainly  as  useful  as  the  cophenetic  correlation  co¬ 
efficient  -  especially  for  ordinal  input  data.  Their  most  serious  flaw  is 
that  they  rank  order  both  the  input  and  the  output  dissimilarity  measures.  For 
that  reason,  the  following  outputs  would  be  treated  as  being  identical: 


Level 

hl 

h2 

h3 

h4 

h5 

E 

P  x  P 

P  x  P 

P  x 

P 

P  x  p 

E 

E 

P  x  P 

P  x 

P 

P  x  P 

E 

E 

E 

P  X 

P 

P  x  P 

E 

E 

E 

E 

P  X  P 

Here  E  is  some  fixed  equivalence  relation  on  the  set  P. 

We  now  introduce  an  optimality  measure  that  directly  determines  how  well  a 
Type  I  method  performs.  One  should  first  note  that  a  Type  I  cluster  method  tries 
to  group  {a,b}  into  a  single  cluster  at  level  h  if  d(a,b)  £  h,  and  tries 
to  leave  it  ungrouped  if  d(a,b)  >  h.  Suppose  the  input  DC  d  on  P  has  range 
hj,h2> . . . ,ht  where  hj  <  h2  <  ...  <  ht-  Suppose  further  that  d(a,b)  =  h^ 
and  Fd(a,b)  =  h^  (k  >  0)  .  One  then  has 


Level  h. 

J 

Classification  of  (a,b) 

Explanation 

j  <  i 

Proper 

d(a,b)  >  h. 

Fd(a,b)  >  h. 

i  +  k  >  j  ^  i 

Improper 

d(a,b)  <  h. 

Fd(a,b)  >  h. 

j  ^  k  +  i 

Proper 

d(a,b)  <  Ik 

Fd(a,b)  <  h. 

Thus  there  are  k  levels  at  which  (a,b)  is  not  properly  classified.  If 
d(a,b)  =  h^  and  Fd(a,b)  =  h^  ^  ,  a  similar  argument  shows  that  (a,b)  is 

not  properly  classified  at  k  levels.  But  this  makes  it  extremely  easy  to 
count  up  the  number  of  points  at  each  level  that  are  not  properly  classified, 
this  sum  being  taken  over  all  possible  levels.  If  the  input  DC  d  has  as  its 
range  hj,h2>...,ht  (h1  <  h2  <  ...  <  ht)  one  just  replaces  h^  with  i  in 
both  the  input  and  output  DC's  (recalling  that  the  range  of  the  output  is 
contained  in  the  range  of  the  input  DC  and  then  computes 

E | d(a,b)  -  Fd(a,b) |  (a.b  e  P)  . 

This  may  be  normalized  by  dividing  by  the  total  number  of  points  under  consideration.  If 
| P |  =  p,  this  is  simply  tp(p-l)/2,  where  t  is  the  number  of  levels  in  the 
range  of  the  input  data.  Incidentally,  this  leads  to  a  useful  interpretation  of 
the  measure.  If  both  the  selection  of  points  and  levels  are  equally  probable, 
then  this  measure  provides  the  probability  that  a  random  point  be  improperly 
classified  at  a  randomly  chosen  level.  In  addition  to  this,  it  has  a  number  of 
pleasant  properties.  It  is  monotone  equivariant.  It  directly  measures  the  per¬ 
formance  of  a  Type  I  cluster  method.  Finally,  it  cannot  be  "improved"  by  dis¬ 
carding  desirable  clusters.  This  coefficient  will  be  referred  to  as  0P11.  In¬ 
cidentally,  0P6,  0P7,  0P8  are  unique  in  that  they  can  be  improved  by  discarding 
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cluster  levels  of  the  output.  To  illustrate  this,  let  us  again  consider  the 
example  that  was  presented  in  connection  with  the  Goodman- Kruskal  coefficient  y 


Output 


levels 

0P1 

UP2 

0P3 

0P4 

0P5 

0P6 

0P9 

0P10 

0P11 

1,4,7, 

11,15 

0.77 

17.6 

0.50 

3.65 

49 

0.85 

0.65 

0.77 

0.22 

1,4,11, 

15 

0.77 

18.0 

0.51 

3.70 

53 

0.89 

0.68 

0.78 

0.24 

1,4,7, 

15 

0.67 

21.7 

0.62 

4.99 

61 

0.92 

0.57 

0.66 

0.27 

1,4,15 

0.66 

23.1 

0.66 

5.12 

69 

0  98 

0.57 

0.66 

0.31 

1,15 

0.43 

28.6 

0.81 

8.66 

91 

1.00 

0.37 

0.43 

0.40 

There  is  a  final  optimality  measure  that  will  be  introduced.  It  is  of  a 
different  character  than  those  that  have  been  considered  earlier  in  that  it 
tells  how  well  a  given  equivalence  relation  fits  an  input  DC,  as  opposed  to 
determining  how  well  the  output  DC  of  a  cluster  method  fits  the  input  DC. 

It  was  introduced  by  Hubert  ([6], [7]).  To  see  how  it  goes,  consider  a  set  P 
equipped  with  a  DC  d.  If  d(a,b)  <  d(c,e),  Fd(c,e)  £h  and  Fd(a,b)  >  h, 
one  says  that  there  is  a  discrepency  at  level  h.  Let  E  =  TF(d)(h).  Suppose 
E  has  clusters  Cj^,...,  C^  and  that  (C^  |  =  r^.  One  then  defines  to 

be  the  quotient  of  the  number  of  discrepencies  over  the  total  possible  number 
of  discrepencies.  If  |P|  =  p,  this  denominator  is  given  by 


Properties  enjoyed  by  include  the  follov/ing: 

1.  It  is  monotone  equivariant. 

2.  It  deals  with  individual  equivalence  relations. 

3.  A  low  value  of  may  readily  be  interpreted  as  meaning  that  the 

output  at  level  h  provides  a  good  fit  to  the  input  data. 
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4.  ignores  ties  in  the  input  data,  and  for  that  reason  can  give  mis¬ 

leading  results  in  the  presence  of  a  large  number  of  ties.  To  see  this,  take 
P  =  {Oj  ,02, . . .  ,010Q}  with  d  defined  by  dfO^.O^  =  1,  d((h,(L)  =  2  for 

all  other  values  of  i  and  j  (i  /  j).  Then  if  E  has  {O^O^O^}  as  its  only 
nontrivial  class,  then  a^(E)  =  0  despite  the  fact  that  E  does  not  provide  a 
particularly  close  fit  to  d. 

This  is  the  last  of  the  optimality  measures  that  we  shall  consider.  For 
the  reader's  convenience,  these  measures  are  summarized  in  Table  1  of  the 
Appendix. 


3.  A  classification  of  optimality  measures.  At  this  point  a  total  of  11 
global  optimality  measures  have  been  introduced  -  each  of  them  tells  us  some¬ 
thing  about  the  goodness  of  fit  of  the  output  DC  of  a  cluster  method  to  the 
input  DC.  In  order  to  make  some  sense  out  of  these  measures,  and  to  make  an 
intelligent  choice  among  them,  let  us  compare  them  on  some  actual  data.  The 
input  data  is  that  described  in  [15],  pp.  11-16.  The  idea  is  to  start  with  the 
binary  data  contained  in  [15],  Tables  1-5,  introduce  a  5%  random  error  in  each 
character,  add  6  random  characters,  and  finally  discard  10%  of  the  resulting 
characters.  This  data  is  then  converted  to  a  dissimilarity  coefficient  in  each 
of  the  following  ways: 

DC1  (b  +  c)/n  Simple  matching  coefficient. 

DC 4  (b  +  c  +  d)/n  Coefficient  of  Russell  5  Rao. 

DC10  be/ (ad  +  be)  Yule's  coefficient. 

Note:  For  a  pair  J,K  of  objects, 

d  =  the  number  of  shared  0's; 

a  =  the  number  of  shared  l's' 

b  =  number  of  characters  for  which  J  has  1,  K  has  0; 

c  *  number  of  characters  for  which  K  has  1,  J  has  0; 

n=a+b*c+d. 


i 

x 
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For  each  data  set,  10  trials  were  performed,  u  =  .5  clustering  was  applied  and 
all  11  optimality  measures  used.  In  addition  to  this,  10  trials  were  performed 
using  25  random  characters  on  a  10  element  set.  Where  needed  each  optimality 
measure  was  then  converted  to  a  dissimilarity  measure.  The  similarity  between 
the  predictions  made  by  the  optimality  measures  was  then  computed  in  two  different 
ways: 

1.  Using  the  product -moment  correlation; 

2.  Using  the  Goodman-Kruskal  rank-order  correlation. 

(Note.  This  amounts  to  using  0P7  with  T  =  0,  since  there  are  no 
ties  in  the  input  data! . 

These  correlations  were  then  converted  to  dissimilarity  measures  and  u  =  .5- 
clustering  applied.  The  cluster  outputs  appear  in  the  Appendix  as  Tables  2-7,  and 
in  summary  form  in  Tabic  8.  A  brief  examination  of  Table  8  suggests  that  the 
following  grouping  of  optimality  measures  might  be  significant: 

Group  I.  0P2,  0P3,  0P4,  0P5 

Group  II.  0P6,  OP 7 

Group  III.  0P1,  0P9,  0P10,  0P11. 

In  a  sense  this  is  hardly  surprising.  Group  I  contains  the  distance  measures,, 

0P6  is  a  minor  modification  of  0P7,  and  Group  III  contains  the  3  correlation 
measures  as  well  as  0P11.  This  leaves  0P8  unclassified.  We  choose  to 
place  it  in  Group  II  because  its  very  definition  shows  it  tb  be  closely  related 
to  OP 7 . 

In  what  follows,  we  shall  take  as  representative  cotimality  measures  the 
fol lowing: 

0P2  from  Group  I , 

0P7-8  from  Group  II 

0P1  from  Group  III 

0P11  and  0P12  because  of  their  desirable  properties. 
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A  classification  of  optimality  measures  was  also  undertaken  by  Gower  and 
Banfield  [4]  with  somewhat  similar  conclusions.  These  authors  used  a  product 
moment  correlation  to  compare  the  various  measures,  and  followed  this  by  a 
principal  coordinates  analysis.  Though  their  choice  of  optimality  measures 
differed  somewhat  from  ours,  they  did  use  0P1,  0P2,  0P3  and  0P9.  Despite 
this,  the  reader  is  urged  to  use  some  caution  in  interpreting  the  results  that 
we  have  just  announced,  as  they  could  be  somewhat  dependent  upon  the  size  of 
the  data  sets  (see  [4]  pp.  355-357). 

4.  The  cluster  techniques.  Having  arrived  at  some  reasonable  optimality 
measures,  it  is  now  appropriate  to  apply  them  to  some  actual  data.  The  cluster 
techniques  we  shall  use  have  all  been  described  in  [12],  but  for  the  readers 
convenience,  we  shall  briefly  mention  them  here  again.  The  input  data  should 
be  regarded  as  a  DC  on  a  finite  set  P  of  objects  to  be  classified.  Let 
h0  .  hx  .  ...  <  h  be  the  range  of  d.  The  techniques  are  all  agglomerative. 

At  level  hQ,  J  and  K  are  grouped  together  if  d(J,K)  *  hQ;  the  transitive 
closure  of  the  resulting  relation  is  then  formed.  At  level  the  input 

data  consists  of  d  and  the  clusters  that  were  formed  at  level  h^.  The  tech¬ 
niques  differ  only  in  the  criterion  they  employfor  merging  2  clusters  at  level 
A  link  between  clusters  J  ,K  at  that  level  consists  of  a  pair  of  objects 
J,K  with  J  e  J,  K  c  K,  and  d(J,K)  <  h^j .  There  are  two  types  of  algorithms 

u-clustering  (0  ±  u  <_  1).  This  merges  J ,K  if  at  least  a  fraction 

u  of  all  possible  links  have  been  made  between  them. 

(u,v)-clustering  (0  <  u,v  <_  1).  Here  J,K  are  merged  if  at  least  a 
fraction  u  of  the  members  of  J  are  each  linked  to  at  least  a 
fraction  v  of  the  elements  of  K,  and  similarly,  at  least  u  of 

the  elements  of  K  are  each  linked  to  at  least  v  of  the  elements 

of  J. 
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Finally,  in  the  spirit  of  comparison,  we  shall  employ  the  UPGMA  algorithm 
as  described  in  [21],  pp.  230-234.  This  cluster  technique  has  enjoyed  con¬ 
siderable  popularity  with  numerical  taxonomists,  and  tends  to  produce  useful 
cluster  outputs  for  their  purposes.  Despite  this,  it  is  not  monotone  equi- 
variant,  and  also  suffers  from  the  defect  that  its  output  is  dependent  on  the 
labeling  of  the  input  data.  Because  such  techniques  should  not  be  used  on  input 
data  having  only  ordinal  significance,  it  will  be  interesting  to  compare  the 
effectiveness  of  UPGMA  with  that  of  some  of  the  u-  and  uv-techniques . 

5.  Some  numerical  examples.  Several  numerical  examples  will  be  considered. 
On  each  example,  we  shall  apply  single  linkage,  complete  linkage,  u-clustering 
(u  *  .3,  .5,  .7),  uv-clustering  (uv  =  (.2,. 4),  (.2,. 6),  (.4,. 6))  as  well  as 
the  UPGMA  algorithm.  The  idea  will  be  to  comapre  the  optimality  of  these 
cluster  techniques,  as  measured  by  0°I.  0P2,  0P7-3  and  0P11.  The  optimality 
measures  will  be  viewed  as  simple  numerical  measures  of  how  well  a  cluster 
method  has  performed;  no  attempt  will  be  made  to  attach  any  statistical  signi¬ 
ficance  to  their  predictions. 

Example  1.  The  data  consists  of  Hoi zinger  and  Harman's  eight  psychological 
tests  [5]  and  appears  in  Table  9,  with  the  various  cluster  outputs  appearing 
in  Table  10.  Notice  that  apart  from  the  levels  at  which  the  clusters  appear, 
there  are  only  3  distinct  outputs.  The  vat  icus  optimality  measuios  occur  in 
Table  15.  Notice  that  these  measures  do  indeed  ptoduce  different  verdicts. 

OP  1  rates  UPGMA  as  best  with  uv  =  (.2,. 4)  a  close  second.  By  0P2,  UPGMA 
is  best  with  u  *  .5  second  tost.  On  the  other  hand,  th?  Goodman-Kruskal  co¬ 
efficient  tells  us  that  single  linkage,  u  =  .3,  u  *  .5,  uv  *  (.2, .4)  and 
UPGMA  are  all  equally  good.  Finally,  or 11,  which  in  a  certain  sense 


directly  measures  how  many  objects  have  been  misclassified,  puts  uv  =  (.2,. 6) 
best  and  uv  =  (.4,. 6)  second  best.  The  only  agreement  between  these  measures 
is  that  complete  linkage  is  the  worst  choice  of  all  of  those  considered. 

Example  2.  Here  we  consider  some  data  from  Cooley  and  Lohnes  [2],  pp.  133- 
134.  An  explanation  of  the  construction  of  the  data  table  can  be  found  in 
[7].  The  actual  data  is  reproduced  here  as  Table  11  with  the  cluster  outputs  in 
Table  12.  Here  again  the  optimality  measures  (See  Table  15)  provide  a  mixed 
verdict.  By  0P1,  UPGMA  and  uv  =  (.4,. 6)  are  tied  for  first  place,  while 
by  0P2,  UPGMA  is  best  with  uv  *  (.2,. 6),  uv  =  (.2,. 4)  and  uv  *  (.4,. 6) 
close  behind.  The  Goodman-Kruskal  coefficient  rates  UPGMA,  the  3  uv  methods 
and  u  =  .3,  u  =  .7  as  being  equally  good.  Finally,  0P11  puts  uv  =  (.2,. 6) 
and  uv  =  (.4,. 6)  first  and  second  best.  Again,  complete  linkage  is  rated  the 
worst  choice  by  all  of  the  optimality  measures.  Incidentally,  the  outputs  rated 
best  by  Goodman-Kruskal  coincide  with  those  announced  by  Hubert  [7],  p.57  for 
his  "objective  function  hierarchy". 

Example  3.  This  represents  13  diagnostic  types  that  were  discussed  by 
Overall  (19].  His  categorization  produces  the  partition 

123,46789-10,11-12,5,13 

which  appears  in  all  cluster  outputs  with  the  exception  complete  linkage 
(See  Table  13).  Here  uv  *  (.2, .4)  is  rated  best  by  0P1,  UPGMA  by  0P2, 
uv  *  (.4,. 6)  by  Goodman-Kruskal  and  u  *  .5  by  0P11.  The  optimality  measures 
all  agree  that  single  linkage  and  complete  linkage  clustering  are  the  worst 
choices  of  those  considered.  The  reader  might  compare  these  results  with  a 
study  made  by  Hubert  [8]. 
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Example  4.  This  involves  quantifying  the  confusability  among  16  consonant 
phonemes  as  reported  by  Miller  and  Nicely  [18].  The  acutal  data  we  used  appears 
as  matrix  (b)  in  Hubert  and  Baker  [9],  p.  105.  Here  it  is  convenient  to  follow 
the  notation  of  [9],  and  let  the  first  16  integers  denote  the  consonant  phonomes 
ordered  as  follows:  p,  t,  k,  f,  9,  s,  /,  b,  g,  v,  3,  d,  z,  m,  n.  The 
various  cluster  outputs  are  almost  identical  (Table  14),  but  again  the  optimality 
measures  produce  a  somewhat  mixed  verdict.  0P1  rates  as  best  u  *  .3,  u  =  .7, 
uv  =  (.4,. 6)  and  UPGMA;  0P2  puts  UPGMA  best  with  uv  =  (.2,. 6),  second  best;  OP7-8 
rate  u  =  .3,  .u  =  .7,  uv  =  (.2, .6),  uv  =  (.4, .6)  and  UPGMA  as  best;  finally,  0P11 
says  that  the  best  outputs  are  those  produced  by  uv  =  (.2,. 6)  and  uv  =  (.4,. 6). 

As  in  Example  3,  the  optimality  measures  all  conclude  that  single  linkage  and 
complete  linkage  are  the  worst  choices  for  cluster  techniques  of  those  considered. 
Notice  that  the  outputs  for  u  =  .7,  uv  =  (.2,. 6),  uv  =  (.4,. 6)  and  UPGMA  clus¬ 
tering  are  all  equivalent.  The  clusters  that  occur  at  the  first  level  at  which 
no  singleton  clusters  remain  (level  9)  all  occur  in  a  fairly  natural  manner 
and  may  be  given  reasonable  interpretations.  (See  [20],  Table  2,  p.  105). 

They  are: 

123  unvoiced  stops 

45  front  unvoiced  fricatives 

67  back  unvoiced  fricatives 

8- 11-12  front  voiced  consonants 

9- 10  back  voiced  stops 

13-14  back  voiced  fricatives 

15-16  nasals 

The  level  13  partition  consists  of  the  unvoiced  consonants,  the  voiced  consonants, 
and  the  nasals. 

6.  Summary.  Some  of  the  more  commonly  used  optimality  measures  for 
cluster  techniques  were  introduced  and  their  properties  discussed  with  a  view 


toward  their  possible  utility  for  monotone  equivariant  cluster  techniques. 

They  were  grouped  naturally  into  3  classes  and  a  representative  chosen  from 
each  class.  A  new  optimality  measure  was  also  introduced;  it  directly  measures 
the  effectiveness  of  a  certain  type  of  monotone  equivariant  cluster  methods. 
These  measures  were  then  applied  to  several  numerical  examples  to  compare  the 
outputs  of  single  linkage,  complete  linkage  and  UPGMA  with  certain  monotone 
equivariant  cluster  techniques  that  have  recently  been  introduced  by  the 
author.  In  these  examples,  neither  single  linkage  nor  complete  linkage  per¬ 
formed  well;  the  best  overall  performance  seemed  to  be  by  UPGMA,  uv  =  (.2,. 6) 
and  uv  =  (.4,. 6).  When  faced  with  ordinal  input  data,  this  might  be  taken  as 
evidence  that  some  of  the  uv-techniques  could  prove  useful. 

7.  Acknowledgement .  The  computer  programs  needed  for  this  study  were 
written  in  APL  by  Zachary  Smith,  and  the  data  was  processed  on  the  University 
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Symbol 

Name 

Formula  (See  Note  4) 

0P1 

Cophenetic  Correla¬ 

Product  moment  correlation 

tion  Coefficient 

OP  2 

Euclidean  distance 

[Ux.  -  y.)YS 

OP  3 

(Z(x.  -  y^YYzx.V5 

0P4 

[sci  -  (yi/x.))2r5 

OP  5 

Manhattan  distance 

Z lx.  -  y. 1 

1  l  7 1 1 

0P6 

Modified  Goodman - 

(S+-S")/(S++S‘) 

Kruskal 

(See  Note  1) 

0P7 

Goodman-Kruskal 

(S+-S'-T)/(S++S%T) 

(See  Note  2) 

OP8 

Goodman- Kruskal 

(S+-S-+T)/(S+4S‘+T) 

(See  Note  2) 

0P9 

Kendall's  Tau 

0P10 

Spearman's  Rho 

OP11 

(2|xt  -  yil)/[kp(p  -  l)/2] 

where  |P|  =  p  and  k  «  no. 

splitting  levels. 

(See  Note  3) 

Note  1. 

For  definitions  of  S+ 

and  S  ,  see  p.8 

Note  2. 

For  definitions  of  S+, 

S',  T,  see  p.6-7 

Note  3. 

The  input  data  is  first 

rank  ordered.  See  p.  io 

Note  4. 

In  the  table  (x^x^,... 

,xt)  denotes  the  values  of  the 

input  DC  d,  and  (y^ ,y^, • • . ,yt)  the  corresponding  values 
of  the  output  DC  F(d). 
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Table  2.  Cluster  output  for  optimality  measures  with  data  from  Table  1  of  [15] 


Level 


1 


Product -moment 

Goodman-Kruskal 

6  7 

6  7 

2  5,  6  7 

2  5,  6  7 

25,  67,  9  10 

25,  34,  67 

235,  67,  9  10 

25,  34,  6  7,  9  10 

2345,  67,  9  10 

2345,  67,  9  10 

2  3  4  5,  6  7,  1  9  10 

1  11,  2345,  67,  9  10 

2345,  1  6  7  9  10 

1  11,  2345,  6  7  9  10 

2345,  1  6  7  9  10  11 

1  8  11,  2345,  6  7  9  10 

2345,  l  6  7  8  9  10  11 

2  3  4  5,  1  6  7  8  9  lCf  11 

Cluster  output  for  optimality 

measures  with  data  from  Table  6 

Product -moment 

Goodman-Kruskal 

2  5 

2  3 

2  5,  3  4 

2  3,  6  7 

2  5,  3  4,  6  7 

234,  67 

2  3  4  5,  6  7 

2345,  67 

2345,  67,  9  10 

2345,  67,  19 

2345,  67,  1  9  10 

2345,  67,  1  9  10 

2345,  67,  1  8  9  10 

23458,  6  7, 1  9  10 

2345,  1  6  7  8  9  10 

23458,  67,19  10  11 

2  3  4  5  11,  1  6  7  8  9  10 

23458,  1  6  7  9  10  11 

Table  4.  Cluster  output  for  optimality  measures  based  on  data  from  Table  7  of  [15]. 


Level 


1 


Product-moment 


Goodman - Kruska 1 


3  4 

10  25,34 

7,  9  10  2  5,  3  4,  9  10 

6  7,  9  10  2  5,  3  4,  6  7,  9  10 

,  6  7,  9  10  2  3  4  5,  6  7,  9  10 

2  3  4  5,  6  7  1  11,  2  3  4  5,  6  7,  9  10 

,  19  10,  678  2345,  67,  1  9  10  11 

,  1  6  7  8  9  10  23458,  67,  1  9  10  11 

,  1  6  7  8  9  10  11  23458,  1  6  7  9  10  11 


I 


Table  S.  Cluster  output  for  optimality  measures  based  on  data  from  Table  8  of  [15] 


Level 

Product -moment 

Goodman- Kruskal 

1 

2  5 

2  5 

2 

2  5,  6  7 

2  5,  6  7 

3 

25,  34,  67 

25,  34,  67 

4 

2  S,  3  4,  6  7,  9  10 

25,  34,  67,  9  10 

5 

2  3  4  5,  6  7,  9  10 

2  3  4  5,  6  7,  9  10 

6 

2345,  67,  1  9  10 

2345,  67,  1  9  10 

7 

2345,  67,  1  9  10  11 

2345,  67,  1  9  10  11 

8 

2345,  6  7  8,  1  9  10  11 

2345,  678,  1  9  10  11 

9 

2345,  1  6  7  8  9  10  11 

2  3  4  5,  1  6  7  8  9  10  11 

Table  6.  Cluster  output  for  optimality  measures  based  on  data  from  Table  9  of  [15]. 


Level 

Product -moment 

Goodman - Kruska 1 

i 

6  7 

6  7 

2 

2  5,  6  7 

3  4,  6  7 

3 

25,  67,  9  10 

25,  34,  67 

4 

235,  67,  9  10 

25,  34,  67,  9  10 

5 

2345,  67,  9  10 

25,  34,  67,  1  9  10 

6 

2345,  67,  1  9  10 

2  3  4  5,  6  7,  1  9  10 

7 

2345,  67,  1  9  10  11 

2345,  67,  1  9  10  11 

8 

23458,  6  7,1  9  10  11 

2345,  67,  1  8  9  10  11 

9 

23458,  1  6  7  9  10  11 

2  3  45,  1  6  7  8  9  10  11 

Table  7.  Cluster  output  for  optimality  measures  based  on  random  data. 


Level 

Product-moment 

Goodman -Kruskal 

1 

2  5 

9  10 

2 

25,  9  10 

25,  9  10 

3 

235,  9  10 

235,  9  10 

4 

235,  1  9  10 

235,  67,  9  10 

5 

235,  67,  1  9  10 

235,  67,  1  9  10 

6 

2  3  4  5,  6  7,  1  9  10 

2  3  4  5,6  7,  1  9  10 

7 

2  3  4  5,  6  7,  1  8  9  10 

2345,  67,  1  8  9  10 

8 

2345,  16789  10 

2345,  16789  10 

9 

2  3  4  5  11,  1  6  7  8  9  10 

2  3  4  5  11,  1  6  7  8  9  10 
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Table  8.  Number  of  occurrences  of  clusters  in  Tables  2  through  7. 


No. 

Occurrences 

Cluster 

'  “'S 

Cluster 

12 

6  7 

2  3  4  5 

3 

6  7  8 

2  3  4  5  8 

2  3  4  5  11 

1  8  9  10 

11 

2  5 

9  10 

2 

1  11 

10 

1  9  10 

1 

2  3 

1  9 

2  3  4 

6  7  9  10 

1  8  11 

1  6  7  9  10 

1  8  9  10  11 

6 

3  4 

19  10  11 

1  6  7  8  9  10  11 

S 

2  3  5 

4 

1  6  7  8  9  10 

1  6  7  9  10  11 

Table  9.  Holzinger  and  Hannan's  proximity  values  for  eight 
psychological  tests. 


Object 

pair 

DC 

Object 

pair 

DC 

Object 

pair  ! 

{6,7} 

.278 

.665 

B581BB 

{5,7} 

.344 

1 

.665 

{5,6} 

.378 

{1,8} 

.668 

{3,5} 

{7,8} 

.381 

{4,6} 

.673 

{2,6} 

{5,8} 

.422 

{1,5} 

.679 

{2,4} 

{6,8} 

.473 

{1,2} 

.682 

{4,5} 

{1,4} 

.532 

{2,3} 

.683 

{3,7} 

{1,3} 

.597 

{3,4} 

.695 

{2,7} 

.1 

{4,8} 

.609 

{1.7} 

.696 

{2,8} 

A 

{3,8} 

.618 
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Table  10.  Cluster  outputs  for  data  in  Table  9. 


Clusters 


67 

567 

5678 

14.5678 

134.5678 
1345678 
12345678 


Output  DC  value  foi  given  method 
UPGMA  si  ngle _ 'i-.3  u=  ■  5 

.278  .278  .278  .278 


UPGMA 

.278 

.361 

.425 

.532 

.646 

.692 

.757 


uv=( .2, .4) 


.278 

.278 

.278 

.344 

.344 

.344 

.381 

.422 

.422 

.532 

.532 

.532 

.597 

.597 

.597 

.665 

.673 

.665 

.715 

.766 

.715 

0 

.278 

.278 

.278 

I 

0 

.378 

.378 

.278 

5678 

0 

.473 

.422 

.422 

14,5678 

0 

.532 

.532 

.532 

145678 

.679 

.673 

,673 

145678,23 

.683 

.683 

.683 

12345678 

H 

.770 

.753 

,766 

67 

0 

567 

0 

5678 

0 

14,5678 

0 

14,23,5678 

.056 

1234,5678 

.172 

12345678 

Table  11.  Dissimilarity  values  for  data  from  Cooley  and  Lohnes 


KUSH 

mm 

DC 

{1,3} 

.013 

{2,7} 

.123 

{1,7} 

.403 

{5,8} 

.016 

{5,7} 

.152 

{2,5} 

.509 

{1.8} 

.020 

{4,7} 

.165 

{4,5} 

.511 

{•>,  8} 

.028 

{3,6} 

.193 

{4,8} 

.653 

{5,6} 

.038 

{1,6} 

.196 

{2,8} 

.669 

{6,7} 

.OSO 

{7,8} 

.257 

{3,4} 

.815 

{1,5} 

.069 

{2,6} 

.307 

{1.4} 

.832 

{2,4} 

.070 

{4,6} 

.329 

{2,3} 

.840 

{3,5} 

.073 

{3,7} 

.392 

{1,2} 

.860 

{6,8} 

.097 

Table  12.  Cluster  outputs  for  data  from  Table  11. 


Clusters 

a 

Output  DC  value  for  given  method  ] 

u=.  3 

u= .  7 

.2, .4 

.  2,  .6 

_ •  « 6 _ 1 

13 

0 

EB 

.013 

.013 

13,58 

0 

mm 

.016 

.016 

1358 

.038 

.048 

.028 

.050 

.020 

.050 

.050 

1358,67 

.027 

.050 

.050 

.069 

.050 

.069 

.069 

1358,24,67 

.025 

.070 

.070 

.070 

.070 

.070 

.070 

135678,24 

.078 

.216 

.152 

.257 

.097 

.193 

.257 

12345678 

.551 

.329 

.815 

.509 

.653 

.653 

Output  DC  value  for  single  linkage 

13 

0 

.013 

13,58 

0 

.016 

1358 

.038 

.020 

13568 

.083 

.038 

135678 

.118 

.050 

135678,24 

.078 

.070 

12345678 

.123 
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Table  13.  Portion  of  Cluster  Outputs  for  Overall's  13  diagnostic  types 


Output  DC  value 

for  given  method 

a 

single  u=.7 

uv=.2,.4  .2, .6 

.4, .6 

liS, 4789-10 
11-12 

.020 

3.58  10.84 

7.6  7.6 

7.86 

123,46789-10, 

11-12 

.022 

5.18  13.14 

7.81  9.24 

9.24 

12346789-10 

11-12 

.097 

10.57  22.91 

13.55  13.69 

14.55 

Output  DC  value 

for  given  method 

u=.5  UPGMA  | 

123,4789-10, 

11-12 

.020 

7.60  8.26 

123,46789-10, 

11-12 

.022 

9.24  10.70 

123,456789-10, 

11-12 

.076 

17.64  19.51 

Output  DC  value 

for  u= .  3 

123,4-10, 

6789,11-12 

.026 

5.18 

123,46789-10, 

U-12 

.022 

7.6 

12346789-10, 

11-12 

.097 

13.55 

Output  DC  value 

for  complete  linkage 

123,4789-10, 

11-12 

.020 

12.97 

123,4789-10, 

56,11-12 

.030 

13.84 

123,456789-10, 

11-12 

.075 

24.75 
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Table  14.  Cluster  outputs  for  Miller-Nicely  data 


Clusters 

a 

Output  DC  for  given  method 
single  u= . 3 

15-16 

0 

0 

0 

13,15-16 

0 

.140 

.140 

123,15-16 

0 

.175 

.175 

123,45, 1S-16 

0 

.241 

.241 

123,45,8-11,15-16 

0 

.277 

.277 

123,45,8-11,9-10,15-16 

.003 

.310 

.310 

123,45,67,8-11-12,9-10,15-16 

.00182 

.311 

.311 

123,45,67,8-11-12,9-10, 

13-14,15-16 

.000834 

.328 

.328 

123,45,67,8-11-12, 

9-10-13-14,15-16 

.00381 

.349 

.371 

123,45,67,15-16, 

89-10-11-12-13-14 

.0613 

.387 

12345,67,8-11-12,15-16, 

9-10-13-14 

.0144 

.404 

12345,67,15-16 

89-10-11-12-13-14 

.0373 

.399 

.442 

1234567,15-16, 

89-10-11-12-13-14 

.0187 

.404 

.445 

V 

1234567, 

89-10-11-12-13-14-15-16 

.0482 

.476 

.536 

I  thru  16 

.511 

.573 
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Table  14  (continued) 


Clusters 

a 

Output  DC  for 
u  ■  .5 

given  method 

uv»(.2,.4) 

15-16 

0 

0 

0 

13,15-16 

0 

.140 

.140 

123,15-16 

0 

.175 

.175 

123,45,15-16 

O’ 

'.241 

.241 

123,45,8-11,15-16 

0 

.277 

.277 

123,45,8-11,9-10,15-16 

0 

.297 

.297 

123,45,8-11-12,9-10,15-16 

.003 

.310 

.310 

123,45,67,8-11-12,9-10,15-16 

.00182 

.311 

.311 

123,45,67,8-11-12,9-10 

13-14,15-16 

.000834 

.328 

.328 

123,45,67,8-11-12, 

9-10-13-14,15-16 

.00381 

.371 

.349 

123,4567,8-11-12, 

9-10-13-14,15-16 

.0281 

.405 

1234567,8-11-12, 

9-10-13-14,15-16 

.0377 

.445 

.404 

1234567,15-16, 

89-10-11-12-13-14 

.0187 

.452 

.442 

1234567, 

89-10-11-12-13-14-15-16 

«"■  •• 

,048.2 

.545 

.509 

1  thru  16 

.586 

.567 

14  (continued) 
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Table  15.  Optimality  measures  for  clustering  of  data  from  Tables  10,12,15,14 


pa 

Method 

0P1 

OP  2 

0P7 

0P8 

0P11  1 

10 

single 

.936 

.454 

.811 

.811 

mm 

u».  3 

.939 

.323 

.811 

.811 

u*.5 

.936 

.286 

.811 

.811 

.128 

u=.7 

.923 

.330 

.793 

.793 

.126 

complete 

.912 

.620 

.718 

.718 

,231 

.2,. 4 

.940 

.314 

.811 

.811 

.140 

.  2, . 6 

.928 

.301 

.793 

.793 

.114 

.4, .6 

.926 

.314 

.793 

.793 

.117 

UPGMA 

.942 

.267 

.811 

311 

12 

single 

.754 

1.83 

.779 

.779 

.256 

u=.3 

.769 

1.24 

.842 

.842 

.136 

u*.5 

.656 

1.17 

.805 

.805 

.134 

u*.7 

.769 

1,33 

.842 

.842 

.124 

complete 

.655 

1.96 

.789 

.789 

.213 

.2, .4 

.757 

1.03 

.842 

.842 

.134 

.2, .6 

.766 

1.02 

.842 

.842 

.114 

.4, .6 

.771 

1.03 

.842 

.842 

.116 

UPGMA 

.771 

.958 

.842 

.842 

13 

single 

.617 

164 

.573 

.573 

.269 

u= .  3 

.725 

114 

.697 

.697 

.147 

u*.5 

.726 

100 

.701 

.701 

.128 

u=.  7 

.726 

107 

,,717: 

.717 

.149 

■ 

complete 

.635 

275. 

‘  547,  . 

.647 

.254 

.2, .4 

.732 

115, 

•701 

.701 

.148 

.2, .6 

.724 

101 

.701 

.701 

.134 

.4, .6 

.729 

97.6 

.714 

*714  — 

.131 

UPGMA 

.730 

wmSM 

.701' 

'.701 

14 

single 

.958 

•  V'Sk. 

•s&a. 

''  .868 

.239 

u*.3 

.963 

.356 

•  878  / 

.883 

.128 

u*.5 

.960 

.3|9 

.863 

.#8 

.110: 

u*.7 

.963 

•3$2 

.878 

.483 

.119 

complete 

.944 

.869 

.873 

.182 

.2, .4 

.956 

•42  h 

.871 

.87^ 

.148 

.2,. 6 

.962 

.333 

.878 

.883 

.108... 

.4, .6 

.963 

.34q 

.878 

.883  * 

.109 

UPGMA 

.963 

.322 

.878 

.883 
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